Stat 538 Project: Implementation of Maximum Entropy Discrimination with a Linear Discriminant Function
نویسنده
چکیده
For this project, our goal was to implement Maximum Entropy Discrimination (MED) with a linear discrimination function for binary classification purposes. This technique was presented by Jaakola, Meila, and Jebara in “Maximum Entropy Discrimination” (1999). Their paper provides a generalized framework for discrimination that relies on the maximum entropy principle. One of the interesting aspects of MED is its consideration of distributions over parameters in the discriminative model. Thus, instead of finding a single optimal setting of paramters, MED estimates a distribution over the parameters and this distribution is chosen to satisfy constraints in a manner that is non-prejudiced or does not imply that possession of information not present. We apply this technique with a linear discriminant function first to a common benchmarking dataset for discrimination techniques and second to a classification problem of interest to the author.
منابع مشابه
Discrimination of Golab apple storage time using acoustic impulse response and LDA and QDA discriminant analysis techniques
ABSTRACT- Firmness is one of the most important quality indicators for apple fruits, which is highly correlated with the storage time. The acoustic impulse response technique is one of the most commonly used nondestructive detection methods for evaluating apple firmness. This paper presents a non-destructive method for classification of Iranian apple (Malus domestica Borkh. cv. Golab) according...
متن کاملDiscrimination of teachers with high and low job burnout on the basis of organizational commitment and work ethic
Job burnout is the person's reaction to interpersonal stressors in the workplace. The aim of the present study was the discrimination of teachers with high and low job burnout on the basis of work ethic and organizational commitment. The research method was causal-comparative. The population consisted of all male and female employed teachers with different educational levels in the 2016-2017 ac...
متن کاملA New Quadratic Classifier Applied to Biometric Recognition
In biometric recognition applications, the number of training examples per class is limited and consequently the conventional quadratic classifier either performs poorly or cannot be calculated. Other non-conventional quadratic classifiers have been used in limited sample and high dimensional classification problems. In this paper, a new quadratic classifier called Maximum Entropy Covariance Se...
متن کاملA new topological entropy-based approach for measuring similarities among piecewise linear functions
In this paper we present a novel methodology based on a topological entropy, the so-called persistent entropy, for addressing the comparison between discrete piecewise linear functions. The comparison is certified by the stability theorem for persistent entropy. The theorem is used in the implementation of a new algorithm. The algorithm transforms a discrete piecewise linear function into a fil...
متن کاملA General Methodology for Simultaneous Representation and Discrimination of Multiple Object Classes
In this paper we address a new general method for linear and nonlinear feature extraction for simultaneous representation and classi cation. We call this approach the maximum representation and discrimination feature (MRDF) method. We develop a novel nonlinear eigenfeature extraction (NLEF) technique to represent data with closed-form solutions and use it to derive a nonlinear MRDF algorithm. R...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008